Scienti c Data Processing Using the DBC 1
نویسندگان
چکیده
The Distributed Batch Controller (DBC) supports scientiic batch data processing. The DBC distributes batch jobs to one or more pools of workstations and monitors and controls their execution. The pools themselves may be geographically distributed, and need not be dedicated to processing batch jobs. We describe the use of the DBC in a large scientiic data processing application, namely the generation of atmospheric temperature and humidity prooles from satellite data. This application shows that the DBC can be an eeective platform for distributed batch processing. It also highlights several design and implementation issues that arise in distributed data processing systems.
منابع مشابه
Distributed Scientiic Data Processing Using the Dbc
The Distributed Batch Controller DBC supports scienti c batch data processing The DBC dis tributes batch jobs to one or more pools of workstations and monitors and controls their execution The pools themselves may be geographically distributed and need not be dedicated to process ing batch jobs We describe the use of the DBC in a large scienti c data processing application namely the generation...
متن کاملThe Dbc: Processing Scientiic Data over the Internet
We present the Distributed Batch Controller DBC a system built to support batch processing of large scienti c datasets The DBC implements a federation of autonomous workstation pools which may be widely distributed Individual batch jobs are executed using idle workstations in these pools Input data are staged to the pool before processing begins We describe the architecture and implementation o...
متن کاملThe DBC: Processing Scientific Data Over the Internet
We present the Distributed Batch Controller (DBC}, a system built to support batch processing of large scienti$c datasets. The DBC implements a federation of autonomous workstation pools, which may be widely distributed. Individual batch ,jobs are executed using idle workstations in these pools. Input data are staged to the pool before processing begins. We describe the architecture and impleme...
متن کاملThe DBC : Processing Scienti
We present the Distributed Batch Controller (DBC), a system built to support batch processing of large scientiic datasets. The DBC implements a federation of autonomous workstation pools, which may be widely-distributed. Individual batch jobs are executed using idle workstations in these pools. Input data are staged to the pool before processing begins. We describe the architecture and implemen...
متن کاملObject-Relational Queries into Multidimensional Databases with the Active Data Repository
As computational power and storage capacity increase, processing and analyzing large volumes of multi-dimensional datasets play an increasingly important role in many domains of scienti c research. Scienti c applications that make use of very large scienti c datasets have several important characteristics: datasets consist of complex data and are usually multi-dimensional; applications usually ...
متن کامل